Papers with Long Chain-of-Thought
RoT: Enhancing Table Reasoning with Iterative Row-Wise Traversals (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in reasoning large language models (RLLMs) have significantly enhanced reasoning capabilities, leading to brilliant performance on table reasoning. |
| Approach: | They propose a method which performs iterative row-wise table traversal, allowing for reasoning extension and reflection-based refinement at each traversal. |
| Outcome: | Experiments show that the proposed method outperforms RLLMs on WikiTableQuestions and TableBench by 4.3% and achieves state-of-the-art results with comparable models. |
MixKVQ: Query-Aware Mixed-Precision KV Cache Quantization for Long-Context Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing low-bit quantization methods often exhibit severe performance degradation on complex reasoning tasks. |
| Approach: | They propose a plug-and-play method that uses a key channel's intrinsic quantization difficulty and relevance to the query to identify and preserve critical key channels that need higher precision. |
| Outcome: | Experiments on complex reasoning datasets show that the proposed method outperforms low-bit methods at a substantially reduced memory footprint. |
What Factors Affect LLMs and RLLMs in Financial Question Answering? (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on large language models and reasoning large language model (RLLMs) however, there are few studies that explore what methods can fully unlock the performance of LLMs and RLLM in the financial domain. |
| Approach: | They examine the effects of prompting methods, agentic frameworks, and multilingual alignment methods on financial question-answering tasks. |
| Outcome: | The results show that prompting methods and agent frameworks improve LLMs' performance . the authors suggest that these frameworks can be used to enhance LLM performance if they are implemented in financial domains. |
Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models (2026.acl-long)
Copied to clipboard
Runxuan Liu, Xianhao Ou, Xinyan Ma, Jiyuan Wang, Jiafeng Liang, Jiaqi Li, Tao He, Zheng Chu, Rongchuan Mu, Zekun Wang, Baoxin Wang, Dayong Wu, Ming Liu, Shijin Wang, Guoping Hu, Bing Qin
| Challenge: | Existing methods for long chain-of-thought (LCoT) are coarse-grained, reward hacking, and poor generalization. |
| Approach: | They propose a Long Chain-of-Thought (LCoT) model that integrates reinforcement learning with verifiable rewards with a process-aware verification approach. |
| Outcome: | The proposed model improves reasoning and code generation tasks while reducing the cost of training and performance bottlenecks. |
CRISP: Compressing Redundancy in Chain-of-Thought via Intrinsic Saliency Pruning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to compress CoT with external compressors fail to align with the model’s internal reasoning dynamics, resulting in the loss of critical logical steps. |
| Approach: | They propose a framework that exploits the model’s intrinsic saliency to compress CoT by exploiting its reasoning termination token . |
| Outcome: | The proposed framework reduces redundancy in reasoning chain by exploiting the model’s intrinsic saliency. |
Rose-SQL: Role-State Evolution Guided Structured Reasoning for Multi-Turn Text-to-SQL (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multi-turn Text-to-SQL tasks rely on unstable APIs or expensive fine-tuning. |
| Approach: | They propose a training-free framework that leverages small-scale LRMs through in-context learning to enable accurate context-dependent parsing. |
| Outcome: | The proposed framework outperforms in-context learning baselines at the 4B scale and surpasses state-of-the-art models at the 8B and 14B scales. |